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ABSTRACT 


This thesis analyzes retention behavior of P-coded naval officers and 
derives a model to estimate retention rates for this group of officers 
conditioned on their respective year of graduation and the Subspecialty- 
code obtained following completion of postgraduate education. The model 
is based on Bayes' estimation technique. 

The estimates resulting from applying the model to the data obtained 
by observing the behavior of 3,981 naval officers who were graduated between 
1970 and 1975 and who obtained one of 4l selected Subspecialty-codes are 
analyzed with respect to common trends and differences in the behavior 
as well as with respect to the usefulness of the Bayes' estimation tech- 
nique underlying the model. 

It is found that the model yields reliable estimates of the retention 
rates that can provide a meaningful substitute for actually observed rates 
especially within prediction models. The author finally recommends an 
approach that extends his model into a prediction model for the retention- 


rates of P-coded naval officers. 
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I. INTRODUCTION 


The estimation of retention rates for P-coded naval offi- 
cers has been a major problem for personnel planners. The 
procedure currently used by the Navy overestimates the actual 
need." 

One of the reasons for this overestimation is the fact 
that the samples available are too small to provide a basis 
for reliable estimation by traditional procedures. 

In a Memorandum of 21 September 1979, Weitzman? suggests 


two approaches toa solution to this problem: 


a. Aggregation of subsamples to increase the reliability 
of traditional estimators; 


b. Development of new estimation models. 
One of the basic devices to cope with the problem of too small 
sample sizes in this context is the Bayesian estimation tech- 
nique. It could provide the basis for a new estimation model. 

It is the purpose of this study to derive a Bayesian esti- 
mator which will yield reliable estimates of retention rates 
of P-coded naval officers conditioned on their respective year 
of graduation and their respective Subspeciality-code obtained 


after graduation. 


Те Етан, R.A., Memorandum ND4(54Wz)/bd 21 Sept 1979: 
Naval Officer Subspecialty Analysis. 


“See Weitzman, R. A., Memorandum NC4 





The data base for this study consisted of 3,981 naval offi- 
cers who were graduated in the years 1970 to 1975 and who at- 
tained one of 41 selected Subspeciality-codes which are 
related to the different curricula of the Naval Postgraduate 
School. The retention behavior of these officers was observed 
from the year of graduation up to the year 1979, which was the 
last year that corresponding data were obtained from the Of- 
ficer Master File and Attrition File. The observed retention 
rates are analyzed mainly with respect to 


- differences in the behavior of the graduates over the 
six subsequent graduation years, 


- trends within the respective graduation-year groups 
over years k after graduation, and 


- differences between the ten Subspecialty-code groups into 
which the 41 Subspecialty-codes were grouped. 


Based on the Bayesian estimator for this study and the specific 
phenomena observed, a model is formulated that allows use of 
the estimator to obtain an estimate of the retention rate 

that can provide a more reliable substitute than the actually 
observed rate, especially within prediction models. 

The estimates are calculated and their usefulness as a 
reliable basis for prediction models is analyzed. The analysis 
and discussion of the obtained results are concluded by corre- 
lating the estimates with their respective rates. This pro- 
cedure led to final conclusions about the actual retention 
behavior as well as about the usefulness of the Bayesian 


esimation technique within this context. 





Finally, recommendations are given with respect to pos- 


sible extensions of the derived model into prediction models. 





II. BAYESIAN ANALYSIS 


A. IDEA OF BAYESIAN ANALYSIS 

Bayesian Analysis is an attempt to incorporate into the 
process of statistical inference all information about the 
underlying state of nature of a random phenomenon. It toler- 
ates explicitly the use of subjective judgement where a 
priori verifiable information is not available.? 

Suppose there exists a set of mutually exclusive events, 
say officer A remains in service or he leaves service in a 
certain year k and a priori there exists no certainty about 
his behavior. Then the Bayesian estimation technique allows 
for assigning prior probabilities to each of these events on 
the basis of whatever evidence is known or subjectively as- 
sumed in advance. Then, if additional facts become available, 
for example retention rates for a group of officers to whom 
officer A may belong, the initial probabilities are revised 
by means of Bayes' Theorem. As a result of this revision pro- 
cess, posterior probabilities are obtained. They do not com- 
pletely supersede the prior information, but they contain it. 

Whether this prior informationis still useful after ad- 
ditional evidence has been obtained depends on the phenomenon 


under consideration. In theory as well as in practice 


3 ; — 
Morgan, B. W., An Introduction to Bayesian Statistical 


Decision Processes, p. I-14, and Preface, Prentice-Hall, 1968. 
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the above described distinctive feature of Bayesian analysis 
is the subject of controversial opinions. Examples of bizarre 
results of Bayesian analysis can be found in almost all stan- 


dard statistics Беби“ 


B. BASIC STRUCTURE OF BAYESIAN ANALYSIS? 


Suppose that it is possible to summarize a priori informa- 
tion about the relative likelihood of where in a specified 
parameter space $1 the unknown value of parameter 9 lies by 
constructing a probability distribution for 9 оп Я. 

Assuming a continuous case, the p.d.f. £(0) of this dis- 
tribution is then called the prior p.d.f. of 9. 

Suppose then that a random sample Х|,...Х, (Vector nota- 
tion: X) is drawn from a distribution with p.d.f. Ё(х|0), 
where the value of 9 is unknown and the prior distribution 
of O has the p.d.f.5(0). The joint p.d.f. of the random 
variables Xi, ЭРЭР X. is in vector notation exl o) with 
marginal joint p.d.f. 


(1) £(X) 


5 £(x10) 5 (0) ao. 


Then after Xi 


х., ..., X, ^" X has been observed, the 
1 n n 


conditional p.d.f. of O given these values 


“Example in Wonnacott, T. H., and Wonnacott, R. J., Intro- 
ductory Statistics, Third Edition, p. 591-593, John Wiley 
£ Sons, 1977. 





The argumentation in this chapter is based on: 
DeGroot, M. H., Probability and Statistics, Menlo Park, 1975. 
Winkler, R. L., Introduction to Bayesian Inference and Decision, 
Holt, Rinehart and Winston, Inc., 1972. Wonnacott, Introductory 
Statistics, 1977. 


ET 





СОЕ Ееее) q o S 


[,£ (X|e)£ (e) ae 


is denoted as the posterior p.d.f., where £(x|e) represents the 
likelihood function and ё (Ө) the prior distribution. 

Equation (2) is exactly the Bayes Theorem for continuous 
random variables. As Winkler? states, this equation provides 
conceptually a convenient way to revise prior information 
when additional evidence by means of sample information is 
obtained. However, except for relatively simple mathematical 
functions, it might prove to be impossible to carry out the 
required integration. 

These potential difficulties led to resorting to the con- 
cept of conjugate prior distributions: inessenence families 
of distributions for which the likelihood function E (0 |X) is 
uniquely determined once a data-generating model is specified. 

Conjugate families-of distributions corresponding to some 
likelihood functions that are important for practical purposes 
have been developed. In the context of this study, in which 
sampling from a stationary and independent Bernoulli process 
is the underlying data-generating model, the conjugate family 
is the family of Beta-distributions. 

Suppose the retention behavior of a randomly chosen group 


of n officers has been observed. 
6. . 
в. L., р. 127. 
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l if officer 1l remained in service in year k 
Let X, = 


0 otherwise 


Then X 22123, X form random sample from a Bernoulli dis- 


pt 
tribution for which the value of 0(0<0<1) is unknown. 
Assuming that the prior distribution of O is a Beta-distribution 


with parameters a and 8 (a > 0, B > 0), then the posterior 


distribution of O given that Xi = Хр)... X. = x. is a Beta- 


> 


distribution with parameters 


a + È KX, and Btn- = а. 
DE i= 1 
C. DEFINITION OF THE BAYES' ESTIMATOR FOR THIS STUDY 
1. Bayes' Estimator 

Based on the observed values of the random vector Х, 
the value of 9 can be estimated. Thus the estimator of 9 
is a real valued function of X denoted by 5(Х). 

To determine the goodness of the estimator in terms 
of the closeness of the estimate to the true value of the 
parameter O, the quadratic loss function is used as suggested 
by most statisticians:' 

(3) L(0,a) = (0- a)”. 
Hence the estimate should be chosen such that E[(9-a)*|x] 


is minimal, where the expected loss is 
Tsee DeGroot, p. 276, and Wonnacott, p. 573. 


ps 





L(0,a) 


Figure I: Quadratic Loss Function for a Given O 
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(4) Е[(9- а) |х] = Јо - a)? кој|х) ао, 


апа E (6|X) denotes the posterior p.d.f., defined with 
equation (2). 

The Bayes' estimator of O is now the function 61x) 
which yields for every possible value x of the random 


vector X an estimate for which the loss according to equa- 


tion (4) is minimal. For the conjugate family of Beta- 


distributions ;n 
: 00 2 
(5) 6 (X) = — — — мае: 


«+В + п 

6*(X) is the mean of the posterior Beta-distribution. 
Given that the optimal estimate 6*(X) is found, then it is 
easily possible to use this revised information as new prior 
information for a second application of Bayes' Theorem. 5 

In this case the posterior distribution after the 
first application of Bayes' Theorem becomes the prior distribu- 
tion for the next stage and can again be revised by newly 
obtained information on the basis of a second sample. 

The nature of Bayesian estimation implies that the 
obtained optimal estimate is a compromise between two or more 
sets of sample information.” In case of considerable dif- 


ferences in the sizes of obtainable samples, larger samples 


pos Winkler, p. 160-162. 


)Wonnacott, p. 546. 
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gain more weight than do smaller samples. This might lead to 
the effect that, independent of the quality of a set of sample 
information, the quantity in terms of the size of the sample 
used in the revision process determines the value of the 
estimate. 

However, as long as with decreasing sample size the 
quality of the obtainable information decreases, this effect 
is desirable. Looking at P-coded officers who belong to a 
certain subspecialty code, it might for example be that within 
a certain period the behavior of only three officers is ob- 
servable. If two of those officers happened to die in a car 
accident, the retention rate for this year, conditioned on 
the Subspecialty-code under consideration, would be 1/3. This 
mathematically "true" rate would undoubtedly be completely 
meaningless as an entry in a prediction model for retention 
behavior. 

2. The Special Problem of a Diffuse Prior Distribution 

Consider a situation in which a prior distribution 
has to be assessed without sufficient a priori information 
relative to some "overwhelming" sample information. Winkler 
denotes this state as being diffuse relative to the sample 
ан ел. © 

Generally this diffuse state is most appropriately 
represented by a diffuse conjugate prior distribution, 


20 inkler, Pis 198. 
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specifically the Uniform (0,1)-distribution which is a Beta- 
distribution with parameters «= 1 апа В = esl Thus equal 
probabilities are assigned to all possible values of © within 
f , and according to Morgan”? the maximum possible error will 
be minimized. However, there exist situations in which the 
applicability of the Uniform (0,1)-distribution as a diffuse 
prior distribution is doubtful.i? 
Suppose that, of a second sample of three officers, 

one remained in service in year k, i.e. the observed actual 
retention rate for year k is 1/3. Suppose further that prior 


information is represented by the Uniform (0,1) -distribution. 


Then the Bayes' estimate will be 


дж = 1 + + 2 
5 


1 + 1 + 3 


This shows that in cases where extremely small samples are 
involved the Uniform (0,1)-distribution which was supposed 
to have no influence on the posterior distribution does not 
act as a diffuse prior distribution. For practical purposes 
in an inferential or decision-making situation, Winkler sug- 
gests therefore to use as parameters of the diffuse prior 


distribution a = 0 and 8 = о From a theoretical standpoint 


11 све Winkler, p. 198-201 and Morgan, p. 46. 


12 мокдап, р. 47. 


1 З ве Winkler, p. 198-204. 


1° Tinkler, p. 202. 
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this implies the involvement of an improper Beta-distribution 
where the total area under the p.d.f. does not equal to one. 
However, looking at the parameters of the prior distribution 
as equivalent to an a priori information status, this approach 
seems to be the only choice, as Winkler states it, i? 

The effect of this approach on the value of the 
estimate is the same as the effect of a large sample size 
in the revision process relative to a small prior base. In 
both cases the posterior distribution will solely depend on 
the sample information. 

3. The Bayes' Estimator Used in This Study 

To estimate retention rates of officers conditioned 
on their respective Subspecialty codes the idea of the suc- 
cessive application of Bayes' Theorem will be — 

It is assumed that a priori the individual decision 
Of an officer to remain in service in year k after he was 
graduated and thus obtained his P-code is appropriately 
represented by a diffuse prior Beta-distribution. 

As the first sample information in the revision pro- 
cess of this prior information, the retention behavior of 
the group m of officers will be measured who belong to the 
same Subspecialty-code group. 1° The resulting posterior 
distribution will then be used as the prior distribution 


er pr 202 


o list of the observed Subspecialty-code groups and the 
Subspecialty codes belonging to them is contained in Table l 
and Appendix A-l. 
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for one more application of Bayes' Theorem. As the second 
sample information, the retention behavior of a subgrouping 
n of officers belonging to the same Subspecialty-code within 
the above used Subspecialty-code group will be measured and 
used to revise the prior distribution obtained in the first 
step. 
In addition to the assumption stated above, Winkler's 
suggestion ‘concerning the diffuse prior distribution will 
be followed, i.e., in calculating the final estimate, the 
parameters of the original prior distribution will be treated 
as if they were zero. 
Let 
y denote the number of officers belonging to n who 
left service up to and including year k after 
graduation and let 
z denote the number of officers belonging to m who 
left service up to and including year k after 
graduation. | 
Then as Bayes' estimate of the rate of officers who left 
service up to and including year k after graduation and belong 
to both of the above described groupings n and m 
202817 Ү 
(6) б* = — — 


О 2888 31 


will Бе Mesa” 


— is one of the estimators that Professor R. A. 
Weitzman (NPS) has suggested for use in pattern analysis to 
cope with the problem of empty or near-empty cells (personal 
communication). 

19 





III. DATA BASE 


A. DESCRIPTION OF THE DATA 
| Data for this study have been provided by the Department 
of the Navy... They were extracted from both the Officer 
Master File (OMF) and the Attrition File (AF). In order to 
conduct the study with a data base as broad as possible, 
records of a total of 6,372 American Navy officers were 
established. The officers were selected according to three 
criteria: 
a. They have been assigned a "р"-соде.1? 
b. They were graduated from a graduate-level program be- 
tween 1960 and 1975, inclusive. 
с. They have obtained one of the 41 Subspecialty-codes 
(SSC) listed in Table 
To be able to extract retention rates conditioned on the 
SSC's selected, the records obtained from above mentioned 
files have to represent the complete group of naval officers 
satisfying the three criteria. First preliminary summary 
statistics about the losses between 1960 and 1969 revealed 
that the number of lost officers seemed to be zero. It was 


Department of the Navy - NMPC, 8 April 1980. 


Dee Eike "B" means "Master level"; in the context of this 
study a P-coded officer has reached at least the Master level. 

20 ће SSC's are related to curricula at NPS (OPNAVNOTE 
1520, 25 June 79). 
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SSC group Subspecialty codes (SSC) 

XX2X хх21 хх22 хх23 хх24 хх25 хх26 xx27 
хх3х xx3l хх32 хх33 хх34 хх38 

xx4x xx42 хх44 хх48 хх49 

хх5х xx5l хх52 хх54 хх55 хх56 

ххбх хх61 хх62 хх63 ххб7 

хх7х хх71  xx72 

хх8х хх81  xx82 

хх9х за хх95 

11хх 1101 1102 1103 

13хх 1301 1302 1304 1305 1306 1307 1308 
Table 1: List of the 41 SSC's Selected for This Study 


found that the data available for this period in the form 


needed contain only officers who were still in service past 


7369. 


Therefore the final data base consists of those offi- 


cers fulfilling criteria a. and c. who were graduated in the 


years 1970 to 1975. 


Their total numbers for the graduation 


years indicated are shown at the top of the next page. 


Data obtainable for each individual and sufficient to 


conduct the study were structured in records as shown in Ap- 


pendix A-2. 


Table 2 contains a listing of the data. 


In order 


to be able to calculate the retention rates for each year k 


after graduation, ten entries for the vector X--which was 


2l 








11117177 


ро че еве e 


see ee 
T | | 


Graduation year Total number of officers 


1970 562 
1971 215 
1972 768 
1973 669 
1974 649 
1975 - 618 
Total data base 3,981 


introduced in Chapter II--were added. They contain for the 
10 calendar years under consideration (1970 - 1979) the value 


l if the officer was graduated and still serves 
in this year, 


O otherwise. 

These modified records served as the basis for any further 
calculations. A detailed listing of the number of officers 
who were graduated in the years 1970 to 1975, categorized 
according to their respective Subspecialty-code (SSC) is 
contained in Appendix B. 
B. RESTRICTIONS AND ASSUMPTIONS IMPOSED BY THE NATURE OF 

THE DATA 

The nature of the data imposed two major restrictions on 
the conduct of the study: 


a. The OMF contains the date of graduation only in the 
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(1) Social Security Number 

(2) Month and year of birth 

(3) Month and year of entry in the system 

(4) Year of graduation from a graduate-level 

program 

(5) Minimum Service Requirement (month and year) 
| (6) Month and year of loss 

(7) First year eligible to retire (year) 

(8) Subspecialty-code (SSC) 


Table 2: Content of an Individual Record as Obtained From 
Department of the Navy - NMPC 





year in which this event occurred. Thus the basic time unit 
for this study is the calendar year. 

b. The Minimum Service Requirement for each officer as 
obtainable from the OMF is not kept updated. Thus no 
analysis is possible relating the loss of a person 
to that date. 

The loss date as extractable from OMF/AF and as contained in 
the records under entry-No. six?! shows 

- the actual loss date when an individual was lost prior 

о 1980, 
- no entry or an expected future loss date when an individual 
was not lost prior to 1980. 
As "first year eligible to retire" (RY), the OMF/AF and the 
records structured for this study show the calculated first 
possible retirement year based on the 20-year limit. This 
date is kept on the OMF/AF even if an individual served 
longer. 
With regard to the loss date, three assumptions had to 
be made: 

a. A person lost in the year recorded as RY was lost due 

to reaching his retirement age. 

b. A person lost after the year recorded as RY was lost 

due to reaching his retirement age. 


— Table 2. 
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C. A person lost during the year prior to the recorded 
RY was lost due to reaching his retirement age if the 
difference between the year an individual joined the 


forces and his actual loss year was found to be д0 


— Table 2: Difference between entries six and three. 
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IV. ANALYSIS OF THE RAW DATA 


A. OBSERVED SAMPLE SIZES AND DURATION OF OBSERVATIONS 

As the purpose of this study is to condition the reten- 
tion behavior of the observed group of officers on their 
respective SSC's, a first check should be devoted to the .. 
number of officers in each SSC. The listing in Appendix B 
reveals extreme differences in sample sizes. They range from 
zero in 16 cases^? and one in 19 cases up to 96 for SSC xx42 
for graduation year 1973. Even if the SSC's are grouped into 
SSC groups, ^^ there remain considerable differences, as 
Table 3 shows. 

As Table 3 already suggests, sample sizes vary also within 
the SSC's over the six subsequent graduation years observed. 
It was found that, as extremes, sample sizes varied for 

- SSC xx42 between 45 and 96 officers, 

- SSC xx44 between 0 and 20 officers, and 

- SSC xx82 between 0 and 48 officers. 
The given variation in group sizes and especially the high 
number of cases with sample sizes of zero or one officers 
will have an effect on the applicability of standard 


“sample size 0: SSC xx44 and 1102 in 1970; SSC 1103 and 


1308 in 1971; SSC xx44 and 1103 in 1972; SSC xx21 in 1973; 
SSC xx44, 1102, and 1307 in 1974; SSC xx21, xx25, xx27, and 
267 in 1975, 


— Table 1. 
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хх2х 33 39 22 34 40 13 
хх3х 106 115 107 100 101 114 
хх4х 92 139 163 155 107 131 
хх5х 93 89 117 96 9 7 87 
ххбх 38 43 53 42 46 49 
хх7х 29 42 49 57 49 44 
хх8х 6 39 63 36 41 34 
xx9x 93 119 83 78 75 56 
11xx 32 43 47 36 57 Б 
13хх 40 47 54 35 36 39 
Total 562 715 768 669 649 618 


Table 3: Number of Officers Within the SSC Groups Who Were 
Graduated in the Years Indicated 
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statistical procedures in analyzing the data and in trying to 
apply estimation techniques to them. 
The problem is intensified by the limited amount of years 
k after graduation for which observations were possible. 
As retention rates in the first few years after gradua- 
tion can be expected to be high 
- the amount of variation over the observed time period can 
be expected to be extremely small and thus loss rates can 
be expected to stay close to zero. 
- The influence of chance on the variation in cases where 
sample sizes are as small as described can be expected 


to have made the observed loss rates unreliable. 


B. OVERALL LOSSES AND TRENDS 
1. Presentation of Losses Encountered 

Prior to analyzing losses by subspecialties, overall 
losses for the total group of officers observed will be 
examined to get a feel for the actual magnitude of losses 
encountered and to find out about possible trends over time. 

Table 4 shows in part a. the accumulated losses for 
the indicated years k after graduation where k equals one 
in the year of graduation. N denotes the number of officers 
who were graduated in the indicated calendar year. Part b. 
shows the equivalent accumulated loss rates as fraction of 


the losses over the respective base groups N. 
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2. Trend Relative to Years After Graduation 
Table 4 indicates a parallel or at least similar de- 
velopment of the losses relative to the years k after gradua- 
tion for all graduation years i. Figure II shows the 
unaccumulated loss rates (RL, x) for graduation years 
i = 1971, 1973, and 1975 as examples. This figure also in- 


cludes a curve showing the unaccumulated loss rate development 


over years k after graduation regardless of the graduation 


year (RTL,). It is calculated as 
m 
| 7, 
(7) RTL, = цав... ue for each year k^? 
i= 1970 ik 
where 
г; к = loss of graduation-year group, in year k, 
М; = size of graduation-year group, 
1975 nor К = l, 2... 5: 
| 


USO К+ 1 for kK = 6, ..., 10 
All curves show a rapid increase in losses up to the 5th year 
after graduation. After that year, no clear trend is deter- 
minable. The peak in the 5th year is explainable by the 
vanishing effect of the Minimum Service Requirement (MSR). 


“зк = 1 for the year of graduation 
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Мо. 





FIGURE II. 


3 4 5 6 7 8 9 10 


YEARS AFTER GRADUATION 
Development of Unaccumulated Loss Rates 
Over Time (k = 1 for the year of graduation). 


Shown are the curves for graduation years 71, 
73, and 75 and as bold--faced curve the RTL, 
curve according to equation (7). 
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Officers assigned to postgraduate education have to serve on 
active duty for a period of three years for the first year of 
education and one more year for every year thereafter upon 
completion of the program.^? As follows from the description 
of the SSC's selected for this study, almost all of the offi- 
cers observed can be expected to have been graduated from NPS. 
Most of the curricula requires MSRs of at least four years. 
Thus the steep increase of losses in the fifth year could be 
a result of the cessation of the MSR obligation. 

For further clarification of the observed development 
of the losses, it was found to be helpful to distinguish 
between 

a. observable losses due to the fact that officers reach 
their retirement age, denoted by LRo?? and 
b. losses due to other reasons, denoted by LO. 
The data available allowed for an extraction of the LRo and 
the LO. Both rates could now be calculated as respective 
losses over the base groups N;. Figure III shows the unac- 
cumulated rate for the LRo-losses, denoted by RLRO,, and the 


unaccumulated rate for the LO-losses, denoted by RLO All 


К° 
rates are calculated according to equation (7) with the appro- 


priate loss type in the numerator. 


26 ОРМАУМОТЕ 1520, 25 June 1979, Paragraph 6 


ese OPNAVNOTE 1520, Enclosure 1 


28 ве assumptions about the date of retirement in paragraph 
ITI. B. 
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Figure III. 
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4 5 6 7 8 9 10 


YEARS AFTER GRADUATION 


Development of rates for total loss (RTL), 
retirement loss (RLRo,) and loss due to 
other-than-retiremend reasons (RLO,) over 

time (k = 1 for the year of graduafion). 

All rates are calculalted according to equation 
(7) with the appropriate loss type in the 
numerator. 
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Figure III already suggests theincreasing importance 
of retirement losses relative to total losses. This relation 
is emphasized in Figure IV. From the 8th year after gradua- 
tion on, more than 50% of the yearly losses are accountable 
as retirement losses. With the 10th year, the relative im- 
portance of RLRo has reached 81%. The RLRO, /RTL, ratio for 
the year k - l could only be calculated on the basis of two 
out of 3981 cases. 

The trend depicted in Figures III and IV and the like- 
lihood of a steady increase of the relative importance of 
RLo for k greater than ten are essentially attributable to 
two facts: 

a. Officers who have only a few years of service left 
before reaching the 20-year limit--in case this limit 
applies to them--assess the value of the pension ob- 
tainable high enough not to leave deliberately. 

b. With increasing distance from the graduation year, the 
age of the officers will naturally increase. Thus the 
share of officers who will have to retire will increase 
until it approaches 100%. 

The low 34% share of retirement losses in the 5th year 
after graduation is a result of increased losses due to other 
reasons, described earlier. Three major conclusions for 
establishing estimation and prediction models can be drawn 
from the facts so far known: 

a. Both losses, the observable retirement loss (LRo) as well 

as the loss due to other reasons (LO), are not a linear 
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2542-2247: 


Figure IV. 


- е ме ет m = = = = = 2 22 = m е сз ~ - Ds 


4 5 6 7 8 9 0 
YEARS AFTER GRADUATION 
Development of the relative importance 


of retirement losses (ratio RLRo /RTL, ) 


over time (all graduation-year groups 
combined). 
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function of time (k) after graduation. Thus models re- 
quiring linear relationships are not applicable. 

b. The relation between total losses (L) and retirement 
losses (LRo) depicted in Figures III and IV suggest that 
estimation and prediction efforts have to be concentrated 
on the first few years after graduation. 

C. As losses of officers which occur because those officers 
retire are known deterministically, they do not have to 
be estimated. They are given. 

3. Trend Relative to the Year of Graduation 

With respect to trends relative to year i of graduation, 
Table 4 indicates a generally increasing trend in the total 
accumulated losses observed. 

In observing retention behavior of regular Marine Corps 
Officers, McAfee Found that the probability that an officer 
still stays in the system k years after entrance is the same 
independent of the entrance-year group the officer belonged 
to. Based on this assumption, which he verified with tests of 
homogeneity, he was able to construct a classic prediction 
model for retention rates k years after entrance. The proba- 
bility he assumed to be stationary corresponds to the comple- 


ment of the accumulated total loss rate of this study. 


29 їе retirement loss observed (LRo) is not identical with 
the retirement loss which could be calculated once a group of 
officers has entered the system. Part of the group will be lost 
due to other reasons before those officers reach their retirement 
age. Implications will be shown later. 


O ucafee, C. K., ACohort Model for Predicting Retention of 
Regular Marine Corps Officers, MS Thesis NPS, MOnterey, 1970. 
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The data underlying this study do not suggest station- 
arity for the accumulated total losses with respect to subsequent 
graduation-year groups. For the years after graduation k = 3, 

4, 6, 7 and 8, accumulated total loss rates (RAL; p)? are in- 


creasing over the whole range of subsequent graduation years i. 


Only for k = 5 do the КАТ; decrease from 1974 as graduation 
,? 


К 
year i on. Accumulated loss rates due to other-than-retirement 
reasons (RALO; y), as one part of the total losses, show the 
same trend for k = 3, 5, 6, and 7. However, the increase 

occurs with a smaller rate of change and the decrease for k = 5 
from graduation year 1974 on is more obvious. For k = 4, and 8, 
к 
tion year, too. The trend for the accumulated retirement 


decrease in the last respectively observable graduda- 


к), аз the second group of the total losses, 


is increasing for all years k after graduation over the range 


losses (КАТКО; 
, 


of the subsequent graduation years i. 

Figure V shows the above described developments for 
Бин 1 in part a., for p in part b., and for RAC OEE 
in part c. for years after graduation k = 3, 4, 5, 6, 7, and 8 
over the six graduation years. 

Prior to carrying out statistical tests to determine 
the significance of the differences among the six independent 
graduation-year groups for various years k after graduation, 
no certain conclusions about the stationary at least of the 


unaccumulated losses are possible. However, two summarizing 


remarks can be made: 
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a. Accumulated losses are generally increasing for all 
observed years k after graduation with increasing 
years of graduation. 

b. The fact that accumulated retirement losses (ALRO, у) 
follow this increasing trend too might be caused by 
two reasons: 

- Postgraduate education starts progressively later 
in the career of Navy officers. Thus, with increas- 
ing graduation year, the average age of the graduates 
is higher. 

- Progressively fewer P-coded officers pass the 20-year 
limit. Thus, with increasing graduation year, more 
officers retire after 20 years of service. 

4, Hypothesis Testing for Stationarity 

As stated in paragraph IV.B.2, retirement losses are 
assumed to be known. They do not have to be estimated. 

Thus, in testing the significance of differences 
between the six graduation-year groups, the main concern has 
to be with the losses for other-than-retirement reasons. Tests 
will have to be performed for 

- accumulated losses due to other-than-retirement reasons 
(ALO), and 

- unaccumulated losses due to other-than-retirement reasons 
(LO). 


For this purpose, Chi-square tests for independent samples have 
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been chosen. The tests were applied to the data according to 
the procedure suggested by Siegel.?l 
For each year k after graduation, there is a contin- 
gency table constructable with rows representing the graduation- 
year groups and two columns representing the category of 
officers who were lost versus the category of officers who were 
still in service. The requirement. for each of the cells within 
the contingency table to obtain an expected frequency of five 
or more for more than 80$ of the cells is fulfilled for k > 3. 
Tests were carried out for k = 4, 5, 6, and 7. 
Two hypotheses with the following Но were tested: 
а. Н_: The graduation-year groups do not differ with respect 
to ALO for a given year k after graduation, 
b. H_: The graduation-year groups do not differ with respect 
to LO for a given year k after graduation. 
As was to be expected for the accumulated loss case 


(ALO), H. was rejected for all k at a leve of signficance less 


O 
than 0.00001. However, leaving off graduation-year groups 1970 


and 1971 led to an acceptance of H_ at a level of significance 


O 


bigger than 0.1. That means for the latter case that if Но 


were rejected the error probability would be bigger than 0.1. 


For the unaccumulated case (LO), H. was rejected for k = 4 and 


О 
k = 5 at a level of significance of less than 0.0001. However 


31 | — 
Siegel, S., Nonparametric Statistics for the Behavioral 
Sciences, McGraw-Hill New York, 1956. 
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Но was accepted for k = 6 and k = 7 at a significance level 
bigger than 0.1. 

The results of the Chi-square tests seem to indicate 
that the differences between the graduation-year groups with 
respect to ALO and LO are not significant at the significance 
levels stated when only graduation years after 1971 are 
considered. 

However, especially when for the ALO case the develop- 
ment for k = 6 is considered, as shown in Figure V, then the 
result of the Chi-square test to accept the independence hy- 
pothesis should not be valued too highly. The reason for the 
discrepancy between reality and test results appears to be 
twofold: On the one hand, the total number — is 
inflated?? in comparison to the actual frequencies in the loss 
category of the contingency table. According to Siegel, this 
invalidates the test. On the other hand, the test is not 
sensitive to trends. This can be easily recognized from the 
construction of the statistic.?? 

Using as a line fitting procedure the linear regression 
for Е for k = 6 and using the five graduation years 
і = 1970, ..., 1974 X=1,2, ..., 5 as the carriers the fitted 
line equation is 


ОБИИ есь. то. 


33 ее Siegel, S., p. 175. 
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БАГО, a> 008390 + 0.0234x with д^ = (оба 
, 


The positive slope of the line shows the increasing trend 
already recognized in Figure V. The following example il- 
luminates the magnitude of the losses: Given that 600 of- 
ficers graduated each year, then the losses due to other-than- 
retirement reasons up to the 6th year after graduation were: 

- 37 officers of the first graduation-year group, 

- 80 officers of the 4th graduation-year group, and 

extrapolating 

- l64 officers of the lOth graduation-year group. 

This trend is certainly significant. 

The findings with respect to the development of losses 
relative to the year of graduation allow essentially two 
major conclusions: 

a. Any model construction for estimation and prediction of 
losses of P-coded officers conditioned on the graduation- 
year group the officer belongs to that is based on the 
general assumption that losses occur independently from 
the graduation year does not comply with reality. 

b. The trends found for accumulated losses up to and in- 
cluding a year k after graduation over sequential gradua- 
tion years are quantifiable. Using simple linear 


regression with graduation years as the independent 


— Еок ВАГО. 


for graduation years i - 1970, ..., 1974 
are contained in Tablas 


63 (р) of Appendix D. 
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variable seems to be a starting point to predict accu- 
mulated losses in future years k after graduation for 


officers belonging to a specified graduation-year group. 
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V. ESTIMATION OF LOSSES CONDITIONED ON GRADUATION-YEARS AND 
SUBSPECIALTY CODES 
A. DERIVATION OF THE MODEL 
In Chapter II iuc Bayes Estimator that will be used in 
estimating loss rates was derived. In the previous chapter 
it was shown that it is possible to exclude retirement losses 
from the application of the Bayesian estimation technique. 
As it is desired to estimate losses conditioned on the 
SSC an officer has obtained, it was necessary to extract the 
accumulated observable retirement losses (ALRo), the accumulated 
losses due to other reasons (ALO), and the accumulated total 
losses (AL) that occur up to and including the k-th year 
after graduation 
- for each graduation-year group and within those 
- for each of the 41 SSC's. 


Thus the numeric losses AL. . k ALO. . k and ALRO; were 
, , 


1,) 1,2 
obtained, where the subscripts 


„јак 


1— 70, ..., 75 stand for the graduation-year observed 


21, ..., 1308 stand for the 41 SSC's included, and 


гт” .., К stand for the years k after graduation with 


79 
К-9 being the k reached in calendar year 79. 
In the following derivation of the model the subscripts 
will be omitted and it is understood that the losses refer to 


a certain graduation-year i, a certain year k after graduation, 


and a certain SSC j. Assuming now that ALO and ALRo are 
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mutually exclusive, then 


(8) AL = ALO + ALRo for each i,j,k. 
As was already mentioned in paragraph 4.2.2. ALRo is not 
identical with the retirement loss (ALR) obtainable by cal- 
culating from the personal data of each individual the year 
k after graduation when he would reach his retirement age. 


The relation between ALR and ALRo can be described by 
(9) ALRo = ALR - (ALON ALR) 


where (ALON ALR) is the retirement loss that would have been 
observed in addition to ALRo for year k after graduation had 
some officers not been lost due to other-than-retirement 
reasons prior to reaching their retirement age in year k 
after graduation. Thus equation (8) becomes 

(10) AL = ALO + ALR - (ALOM ALR). 
Calculating for each i,j,k total accumulated loss rates (r) 


from the left side of equation (8) yields 


d) rs A 
where N is the number of graduates belonging to graduation 
year i and to SSC j. 

Calculating r from the right side of equation (8) yields 


ALO + ALRo 


(12) r = N 


which can be algebraically manipulated and rewritten to 


ALO ALRO 


N 


(13) rz 
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Equation (13) gives a basis for application of the Bayes 
Estimation Technique to the losses due to other-than-retirement 


reasons (ALO) and for including external given retirement 


се» > 
Let 
= ALO 
PALO = N and 
кв“ — — 
( N = ALO ) 


then equation (13) can be rewritten as 


(14) r= АТО + АТВ ( 1 - Pano ) 


Assuming independence between retirement losses and losses 
due to other-than-retirement reasons, equation (14) is the 
probability statement corresponding to equation (10), where 

г = Р (ап officer belonging to i and j is lost by year k) 
and PALO and стр аге the corresponding probabilities for 
the loss reasons described by ALO and ALR. 

An alternative way to reach the result shown in equation 
(14) by making use of conditional probabilities is shown in 
Appendix C. Now, instead of the actual observed r the 


ALO 


Bayesian estimate bALO will be used. Thus equation (14) can 


be rewritten to obtain the equation for the estimate (b) for 


m St this-study ALR were not given externally, but they 


are calculable by applying РАТЬ EOFN. 
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c 


the accumulated total losses: 


(15) be=b че E (1- Bar 


ALO ALR 


О 
where the estimates and rates have to be calculated for each 
graduation year i and within it for each SSC j to get the loss 


estimate for each observable year k after graduation. 


B. DERIVATION OF THE ESTIMATOR FOR THE MODEL 


According to the definition of paragraph II.C. the esti- 


mate bALO will now be derived and combined with the retirement 
loss ТАРБ 25 stated in equation (15) of the previous chapter. 
Let 
Mi h denote the number of officers belonging to 
Subspecialty-code group нээ having graduated in 
graduation year i; 
De denote the number of officers belonging to SSC j, 
where j is one of the SSC's belonging to SSC group 
h who were graduated in the same year i; 
— denote the number of officers belonging to Us SN 
who have been lost up to and including year k 
after graduation for other than retirement reasons; 
and let 
У ак denote the number of officers опат to 2 
who have been lost up to and including year k 
36 


There are 10 SSC.groups h as specified in paragraph IV.A. 
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after graduation for other than retirement reasons. 


The Bayesian estimate for the loss rate r where 


ALO;i,j,k' 
r | а= “i, jk 
LO;i,]j Tas 
A 3, 1,3 
for each i, j, k as specified in paragraph V.A will be calcu- 


lated according to equation (6) in paragraph II.C as 


ZU E T uae 
b = 1,1,К Yi,j,k 


(16) ALO;i,j,K Mi h D 


for each i, j, k as specified in paragraph V.A and each h as 
specified above. The calculation of the estimate b ALO is 
37 


possible as long as m. is not empty. 


ah 

The construction of the Bayesian estimate, as explained 
in Chapter II, would have allowed for including the total 
group of graduates of a graduation year i as a first refining 
sample into the estimator. However, this would have the un- 
desirable effect that this inflated sample would almost com- 
pletely cover up basic differences in the retention behavior 
between officers belonging to different SSC groups and to 
different SSC's. The existence of differences among the SSC 
groups is shown in Figure VI. 

The first histogram shows the accumulated losses due to 


other-than-retirement reasons (ALO) up to year k = 5 as 


average over graduation years 1972 to 1975. The SSC groups 


37 por the six graduation years (i = 1970, ..., 1975) and 
forall SSC groups (h = 1, ..., ХОД m. p Was found not to be 
empty. xij 
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have been ordered in terms of ascending loss rates. The 


second histogram shows the same losses up to year k = 6 as 


38 The order of 


averages over graduation years 1972 to 1974. 
the SSC groups remained the same as in the first histogram. 
In addition, the histograms show the mean losses and lines 
bounding the region of + 1 standard deviation s. Besides 
minor changes in the order of those groups with losses near 
the mean (u), the ranking in terms of ascending loss rates 
stays stable. Groups xx2x and xx5x lie outside the region of 
* ls and groups 13xx and x6xx lie close to the border lines 
of + ls. 
In order to test the significance of the differences 
among the SSC groups, again Chi-square tests were applied as 
introduced in paragraph IV.B.3. 
The hypotheses 
Но: The SSC groups do not differ with respect to their ALO 
rates for k = 5; 
Но: The SSC groups do not differ with respect to their 
ALO rates for k = 6; 

were both rejected at a significance level of less than 0.00001. 
For the calculation of the retirement losses EIS 
which is the second entity needed to estimate the overall loss- 
rate estimate b. . two assumptions have to be made: 


IMS 


сае year of observation was year 1979. There were no 
data available for k - 6 for graduation year 1975 (corresponds 
to calendar year 1980). 
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Subscripts have been added to r as specified above. 


ALR 
50 


ч, 3k denote the number of officers belonging to SSC j 
, ,? 


of graduation year i who retired up to and including 
year k after graduation. *? 
Then, as was shown in paragraph V.A. 


ENSE 


"ШУ г, .. _. = 
BE uuu) aues 


for any i, j, k as specified in chapter V.A. 
for any k than u. . will be zero 


1,К ЕЈ К 
has to be assumed to be zero for the SSC 


Now, if ЈЕ equals у, 


and thus FALR;i,j,k 


j involved. This means that if everyone belonging to n, : 
1, 


was lost up to year k after graduation due to other-than- 

retirement reasons, nobody of that group could have retired. 
The second assumption is necessary for the case that 

nobody belonging to a certain SSC j graduated in a certain 


graduation year i. In this case n; à is zero for that SSC j 
, 


in the specific vear i and u. . and v. . are zero for 
P Y i,j,K Yi,j,k 


all k and for the specific j and i under consideration.  How- 
ever, the Bayesian estimator allows for calculating the estimate 


b as long as at least m. is not zero too, as was shown 


ALO T 
earlier. For calculating the retirement rate, it was assumed 


that if п; 3 were empty it would have the same retirement 


, 
it belongs to, ^ 


rate as the SSC group m. 
qut 


u, i corresponds to ALRo for the graduation year i, the 
SSC j ahd) the year k after graduation under consideration. 


4lonis method was mentioned by Prof. R. Weitzman in his 


lectures at NPS and is known as “Incomplete Tree Method." 
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C. PRESENTATION AND DISCUSSION OF RESULTS 
l. Presentation of Results 

Appendix D shows in six sections--one section for each 
graduation year--loss rates and estimates of the rates con- 
ditioned on the graduation year and the Subspecialty code an 
officer has obtained. 

The graduation-year sections contain the following 
tables: 

- Table 1(D): Accumulated total loss rates (r. то апа 


1,3 


their respective estimates РЕ for each 
SSC j and each year k after graduation for 
the graduation year i of that section. 

- Table 2(D): Accumulated loss rates for other-than- 
retirement losses (Его; і 

к) for the same i, 1, 


- x) and their 
, , 


estimates (b юэ? 
( ALO;1,], 


and k as in Table 1(D). 


- Table 3(D): and r for the 


"i,h,k’ “ALO;i,3,k ALR;1,h,k 


ten SSC groups h; БАР, ge RALO: k' 


for the total group of graduates in that 


and RALR. 
1,К 


graduation year i and for all years k after 


Y 


graduation. 
2. Discussion of Results for Selected Subspecialty Codes 
As it seemed impossible to exhaustively discuss the 
results for all 41 Subspecialty codes involved, three of the 
ten SSC groups with their Subspecialty codes were selected 


according to their special appearance in Figure VI of Chapter 
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У.В. These are: 

- SSC group xx2x which shows low loss rates and extremely 
small sample sizes of the SSC involved, 

- SSC group xx5x which shows the highest loss rates and also 
high sample sizes of the SSC belonging to it, and 

- SSC group xxáx which shows loss rates closest to the mean 
loss rate of the ten SSC groups and which also shows high 
sample sizes of the SSC involved. 

a. Subspecialty Code Group xx2x 

SSC group xx2x seems to be one of the groups that 
caused the rejection of the equivalence tests in paragraph V.B. 
It is the group with the lowest loss rates and with the lowest 
sample sizes of the SSC's belonging to the group. 

Table 5 shows the magnitude of the actual accumulated 
losses due to other-than-retirement reasons (ALO) for graduation 
years 1972 to 1975 up to and including the 5th year, the 6th 
year, and the 7th year after graduation (k equals one in the 
year of graduation). 

A total of four officers out of 119 graduates were 
lost up to and including the 5th year after graduation and only 
two out of 106 graduates were lost up to and including year six 
after graduation. | 

These extremely small losses do not allow Еок кесод- 
nition of any trends over the graduation years or differences 
among the Subspecialty codes. Table 6 shows the group sizes 


of all SSC's in group xx2x, and Table 7 shows the accumulated 
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Graduation Size of Officers lost (ALO) from ssc 


Year group xx2x up to and including SSC size 
5 “ Е 7 

1972 32 І І 1 хх21 3 

1973 34 0 0 0 шанз = 

1974 40 1 1 - хх22 10 

1975 13 2 = - хх24 7 


Table 5: Accumulated losses due to other-than-retirement 
reasons (ALO) in SSC group xx2x for k = 5, 6, 7. 
(Last year of observation is 1979. К = 1 in the 
year of graduation.) 





хх21 хх22 xx23 xx24 xx25 xx26 xx27 


Grad year 
1972 3 9 3 5 6 5 1 
1973 0 11 4 11 2 4 2 
1974 3 10 3 15 1 7 1 
1975 0 4 il 7 0 1 0 


Table 6: Sample sizes of Subspecialty codes in group xx2x for 
graduation years 1972 to 1975. 
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55С Graduation years 


1972 1973 1974 1975 
-ALO__ AL____ALO___AL____ALO____AL_____ ALO___AL_ 
хх21 г 6.333 „333 ---- ---- ,0 ‚0 =---  ---- 
БИит 057 .057 .0 4059 „023 .023 .154 .308 

xx22 r .0 . 0 .0 420 .100 . 200 „0 .0 
b .024 .024 5,0 .0 „040 ‚147 .118 .118 

хх23 г .0 .0 . 0 2250 . .0 ‚0 .0 . 0 
b .029 .029 .0 20 T023 ‚023 „143. 2113 
xx24 r .0 20 „0 20) ‚0 „0 .286 „571 
027 .027 .0 . 0 .018 .018 .200 .520 
20225 т .0 «0 „0 ‚0 .0 1.0 ----  ---- 
b „026 .026 .0 .0 024" 1.0 154 „308 

хх26 г .0 .200 .0 -0 .0 ‚0 . 0 -0 
p (027 .222 .0 -0 ‚021 ‚021 .143 „143 
хх27 г 0 . 0 0 .500 .0 . 0 ---- ---- 
b .030 .030 .0 .500 .024 024 .154 .308 


Table 7:  Accumulated loss rates due to other-than-retirement 
reasons (r ) and their estimates (b L ) and total 
accumulates foss rates (Ea y? and thei? dotimates 
(Dry? for k = 85: 
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loss rates due to other-than-retirement reasons aro? and 


their estimates (b o! as well as the accumulated total loss 


AL 
rates (r) and their estimates (b) for the fifth year after 
graduation. 

As was desired, the estimate rows do not show 
empty cells. Instead, they show group averages according to 
the construction of the Bayesian estimator. The smoothing 
effect of the estimation technique is due to the fact that 
the estimate is a compromise between the information gained 
from the group behavior and the information gained from the 


42 The effect of chance in- 


behavior within a specific SSC. 
fluences on extremely small samples like the SSC's in this 
group is clearly visible in the case of SSC xx24. Up to the 
5th year after graduation there is no loss in graduation-year 
groups 1972 to 1974. Graduation-year group 1975, however, 
not only happens to be smaller than the two previous ones, 
but this group loses two officers for other-than-retirement 
reasons and two more retire. Thus, more than 50$ of this 
group are lost within the first five years after graduation. 
Looking at the loss rates only, this is an alarming increase. 
As the total SSC group xx2x consists of only 13 officers for 
that graduation year, the Bayesian estimate fails to remove 
this obvious chance effect significantly. However, as part 


Lose paragraph II.C.l. 
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of the chance influences are caused by the retirement losses, 
chance effects are less dramatic for the bALO values. This 
supports the idea already mentioned in the context of analyz- 
ing general trends in paragraph IV.B.2 to base prediction 
models on the BALO values and insert known future retirement 
losses in the way described by the model derived in paragraph 
V.A. 
b. Subspecialty-code group xx5x 

SSC group xx5x is the group with the highest loss 
rates for k = 5 as well as for k = 6 in Figure VI. Together 
with groups xx3x and xx4x, it is also a group with high group 
sizes m, y relative to the other groups. Its losses--as shown 
in Figure VI--exceed the region bounded by + 1 standard devi- 
ation significantly. 

Table 8 shows the sizes n; р of the SSC's in this 


, 


group for graduation years 1972 to 1975. 


SSC 
Grad year хх51 ххэ2 хх54 хх55 хх56 
1972 11 19 54 27 6 
1973 11 15 38 26 6 
1974 9 18 28 31 11 
1975 1 17 33 18 7 


Table 8: Sample sizes of Subspecialty codes in group xx5x 
for graduation years 1972 to 1975. 
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Within this group, no extreme low SSC sizes are depicted. 


However the SSC's vary significantly in size. Table 9 shows 


again the accumulated loss rates ALO and r as well as their 

estimates Baro and b. 

55С Graduation-years 

m. E а. а шэн > 
АГО AL ALO AL ALO AL ALO AL 

их] r . 0 .0 -0 20 2222 2222 .083 .083 


хх52 г 2105 2105 .267 .267 .056 .056 „118 „118 


Б .110 „110 „144 „144 2122 21:22 .096 .096 


хх54 г . 204 2:22 .184 2287 „143 . 286 „1.24 . 303 


b .140 .160 .142 E37 .136 .280 .100 . 286 


xx55 r -0 US .038 „192 „194 2299 .056 „222 
Б . 090 .124 - 107 . 250 .148 2251 .086 „247 


хх56 г 20 . 333 d 20 m0 „091 ‚0 „143 


Table 9: Accumulated loss rates due to other-than-retirement 
reasons (r ) and their estimates (b ) and total 
accumulated foss rates (r,.) and theibblEstimates 

= AL 
(Блу) ТОТ ЛЕ = 5. 


Again the "smoothing" effect of the estimation tech- 


nique can be seen. And again the idea is supported that 
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l————— ~ 


prediction models should be hased on the Dar values as car- 


О 


riers rather than on the b yalues: For SSC xx54, which is the 
SSC with the highest sizes n; jr the b values indicate a 

, 
steady increase of losses from graduation year 1972 to 1975. 


О values, the rates ALO and their 


estimates BALO decrease. Thus, only the relative number of 


officers who had to retire increased for the subsequent gradua- 


However, looking at the БАТ 


tion year groups.» For SSC xx56, retirement losses are the 
only cause of variation over the subsequent graduation years. 
c. Subspecialty-code group xx4x 
SSC-group xx4x is the group for which the accumu- 
lated loss rates for k = 5 and k = 6 shown in Figure VI lie 
closest to the mean rates of the ten Subspecialty-code groups. 
It is also the group with the highest group sizes m, 


ih 
graduation years 1971 and 1975. Table 10 shows the sizes 


between 


nij of the SSC in this group for graduation years 1972 to 
1975. 

SSC xx4x not only shows the most extreme differ- 
ences in the SSC sizes but also contains the SSC's with the 
most extreme differences in terms of curricula at the NPS as 
Table 11 shows. However, these differences do not cause 


correspondingly great differences among the loss rates of the 


various SSC's within the SSC group xx4x, as Table 12 shows. 





43 ; 
The fact that retirement losses show an increasing trend 


with increasing graduation-yeasr was already shown in paragraph 
IU B.2, 


59 











SSC 


Grad year хх42 хх44 хх48 хх49 
259972 85 0 34 44 
1973 96 0 25 36 
1974 54 0 25 28 
1975 57 20 30 24 


Table 10: Sample sizes of Subspecialty codes in group xx4x 
for graduation years 1972 to 1975. 


SSC Subspecialty Title Curriculum 

xx42 Operations Research/Systems 360 
Analysis 

Xx44 Anti-Submarine Warfare Systems 525 
Technology 

xx48 Meterology 372 

xx49 Oceanography 440 


Table ll: Subspecialty codes with their title and Curricula 
at NPS 
Source: OPNAVNOTE 1520, 25 June 1979 
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55С Graduation years 
M ИЦ 1972_________„_1273______...-1374_______..- 1975____ 
И ALO____AL_____ ALO____AL_____ ALO____AL_____ ALO____AL__ 
хх42 r .071 ‚094 ‚063 „135 „148 . 167 .140 228 
b .089 -L12 „064 ЗЯ .118 EIS .101 193 
хх44 г ---- ---- =-= ---- ---- ---- .0 ‚0 
b .098 21524 .065 .129 .103 2121 .073 .073 
хх48 r .176 . 206 . 043 .130 .080 . 120 067 . 100 
b „112 ‚143 ‚062 ‚147 ‚098 „138 ‚081 114 
хх49 г 091 114 „083 sL PI .036 .036 .042 .083 
b .097 „119 .068 .096 .089 .089 .077 ‚118 
Table 12:  Accumulated loss rates due to other-than-retirement 


reasons (Cr ) and their estimates (b ) and total 
асеитијање  Фозе rates (r,.) and thei?lHstimates 
ВЕ АТ, 


Figures VII and VIII show the differences in the variation of 
the loss rates and their estimates between group xx5x and 
group xx4x for k = 5 and graduation years 1972 to 1975. Figure 
ALO for the 


SSC's in group xx4x and group xx5x and the region bounded by 


VII shows for each graduation year the mean of the r 
+ 1 standard-deviation. Figure VIII shows the same for the 


respective Dar, In both cases it can be seen that--except 


о: 
for graduation year 1975--the standard deviations are bigger 


for group xx5x relative to group xx4x. 
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Means (y) of the r О of the SSC's in SSC 
groups xxáx and xxBR%and the region bounded 
by + 1 standard deviation (s) for k = 5 years 
after graduation. Shown are graduation-year 
groups 1972 to 1975. 
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Figure VIII: 


Means (yu) of the b 
xx4x and xx5x and ke 


хх5х 


хх4х 


1975 


of the SSC's in SSC groups 
regions bounded by + stan- 


dard deviation (s) for k = 5 years after gradua- 
tion. Shown are graduation-year groups 1972 to 


1975, 
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A comparison of the figures reveals also the 
effect of the Bayesian estimation technique on the differences 
between the losses for each SSC within the SSC group they 
belong to. The size of the standard deviations depicted have 


decreased considerably from the r figure to the b 


ALO ALO figure. 


3. Correlation Between Rates and Their Estimates 

The estimates calculated according to equation (15) 
of paragraph V.A. in conjunction with equation (16) of para- 
graph V.B. are supposed to provide for valid estimates of the 
loss rates conditioned on the graduation year and the SSC. 
Provided there exists a linear relationship between the esti- 
mates b and the actual rates гр the Pearson correlation coef- 
ficient (ry) should be an indication for the closeness of 
the estimates to the actual rates. 

The coefficient is calculated according to the fol- 


lowing equation: 


(18) Por 





where -1« 


L 


total number of estimates - 


total number of rates. 
The graphs included in Appendix E depict the relation 
between rates and estimates for each graduation year. They do 


not reveal any strong pattern of deviation from linearity. 
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However, they show for all graduation years that for rates 
close to zero the estimate b tends to deviate more from the 
actual rate r than for higher loss rates. 

Table 13 summarizes the findings for * for gradua- 
tion years 1970 to 1975. In addition it shows the amount of 
variation of the loss rates that is explained by the estimator. 
denoted by — The total number of estimates--L as shown in 
the table--is the product of the number of SSC's j and the 
number of years k after graduation for the specific graduation 
year for the specific graduation year, where SSC's of size 
zero are excluded for that graduation year. 

In analyzing the correlation between the loss rates 
and their estimates it is possible to answer the question how 


close the behavior of officers belonging to the various SSC's 


follows the trend of the respective SSC groups. 


Graduation years 


r .85 .95 . 93 „91 .76 .87 
br 
r, 2 72 „91 „86 „84 „58 „76 
рк 

L 380 360 304 273 228 185 


Table 13:  Correlation-coefficients r for accumulated total 
зу" -rates r and their estimates b and the respec- 
ry L is the number of coefficients calculated 
ЕВЕ the resp. graduation year. 
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According to the structure of the estimator, — would 
equal 1.0 only if for that graduation year for each of the ten 
SSC groups the loss rates for all SSC's belonging to the SSC 
group were identical. The more lor deviates from 1.0 the more 
differences between the various SSC's and their respective 
SSC groups are encountered. Thus, according to the coef- 
efficients in Table 13, this variation is highest for gradua- 
tion year 1974 and extremely low for graduation year 1971. 

As was mentioned before, chance influences should have more 
impact in smaller groups than for bigger ones. Accordingly 
the coefficients lor should be smaller when only small SSC 
sizes are considered for calculating lpr 


Table 13 compares the r which were obtained for 


br 
SSC sizes 
- bigger than 20 versus smaller than 20, 
- bigger than 10 versus smaller than 10, and 
- bigger than 5 versus smaller than 5. 


The values of ry show generally an increasing trend with in- 


га 
creasing 55С sizes used for calculated them. However, for 
graduation year 1970, 1971, and 1973 the values тр, їпсгеазе 
again when SSC sizes less than five are used for calculating 
them. This unexpected increase becomes explainable when only 
accumulated loss rates due to other than retirement reasons 


т are correlated with their estimates Dar, Now, not only 


ALO О" 
the expected trend is true for all graduation years but the 


differences between the coefficients are more obvious, as Table 


15 shows. 
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SSC sizes selected 





a) GE 20 a) GE 10 a) GE 5 
Grad year b) LT 20 b) LT 10 b) LT 5 
1970 a) „99 (100) .99 (140) „82 (230) 
Б) .83 (280) .81 (240) .92 (150) 
1971 а) с 99) 299 (162) 232 (225) 
Б) .95 (261) -96 (198) «98 (135) 
| 1972 а) .97 (112) .95 (160) 2967 (216) 
| Б) .92 (192) .92 (144) .90 ( 88) 
1973 a) .99 ( 84) „97 (133) „90 (175) 
Б) .90 (189) .89 (140) .92 ( 98) 
1974 a) .99 ( 72) .96 (114) .94 (168) 
b) „173 (156) „71 (114) „68 ( 60) 
E975 a) 297 ( 65) .94 (105) .92 (130) 
b) .86 (120) .86 ( 80) 25501055) 


Table 14: Comparison of correlation coefficients r for 
accumulated total loss rates r and their éstimates 
b under consideration of different SSC sizes. 
(Number of cases in parentheses) 
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SSC sizes selected 


a) GE 20 a) GE 10 a) GE 5 

Grad-year b) LT 20 b) LT 10 b) LT 10 
1970 a) .98 .98 275 
b) . 64 .56 .48 
2971 a) .98 .89 . 74 
Б) .60 „45 .26 
1972 a) .92 .89 ‚83 
р) . 44 .06 .06 
1973 а) .98 .94 . 74 
Ь) al: 2253 32:5 
1974 a) .98 .90 .82 
Б) ‚42 „40 „50 
1975 а) 291 .86 281 
b) .42 .36 ‚24 


Table 15: Comparison of correlation-coefficients ry 4 
АГО АГО 
for loss-rates ALO and their estimates PALO for 


different SSC sizes. 


(Number of cases is the same as in Table 14.) 
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Obviously, the unexpected increase of PE for SSC- 
sizes of less than five individuals was caused by the effect 
of the retirement rate C ALR! which enters the model as rate 
and not as estimate. The resulting adjustment in the direc- 
tion of the observed overall loss rate is relatively bigger 
for small SSC sizes, as was to be expected. 

The extremely low value of lor in Table 15 for gradua- 
tion year 1972 and SSC sizes less than ten is caused by the 
following facts: 19 out of the 41 SSC's did not show any 
losses due to other-than-retirement reasons (ALO) over the 
whole observed time up to year k = 8 after graduation. This 


resulted in 162 cases with r equal to Zero. Out of the 


ALO 
144 cases for SSC sizes of less than 10 П 11221. 


are cases with r equal to zero. 


ALO 
Thirty two of the 138 cases which represent the most 
extreme differences between Faro and PALO and thus contribute 
heavily to the low ry. values are shown in Table 16. The 
SSC's shown are the only ones out of their respective SSC 
groups which have zero ALO losses over the whole observed 
period and they happen to be also the only ones out of their 


groups with SSC sizes less than ten. In addition group xx2x 


consists completely of SSC's with sizes less than ten. Its 


seven SSC's make up 56 cases out of which 50 show PALO values 
of zero. The six remaining cases have an LALO value of .333. 
44 


See Table 14: 18 SSC with less than 10 officers x 8 
observed years k. 
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= 


xx56 PALO . 0 „0 „0 „0 „0 „0 „0 „0 
Baro 513, 20 .0 049 .106 .179 .228 .244 
хх67 PALO .0 ‚0 ‚0 „0 ‚0 20 .0 217 
baLo 20 20 20) 02012211 .148 .185 .204 
хх72 LALO 20 .0 .0 .0 „0 . 0 40 20 
Baro -0 -0 20 0202 098 „157 „235 
1102 LALO 20 20 .0 . 0 „0 20) -0 BU 
КА 0 o (021 (063 .104 .125 .167 
Table 16: Comparison rates of r and their estimates for 


four selected SSC of ARG group of 18 SSC of gradua- 
tion year 1972 which consist of less than ten 
individuals each. 
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The respective DAL values range from .0 to .03. Group 


O 
xx3x--consisting of five SSC's--contributes 3 SSC's to the 
group of SSC's with less than ten individuals. Each of the 
three does not show any ALO losses within the eight observed 
years, whereas the two remaining SSC's show PALO values of 
Memeo .113 for k = 8 and SSC xx3l. This results in differ- 
ences between the PALO values and their respective estimates 
of up to .083. The same reasoning applies to SSC group 13xx, 
which consists of seven SSC's. Three of them belong to the 
class of SSC's with less than ten individuals, and all three 
do not show ALO losses. The losses encountered for the rest 
of the SSC's in group 13хх result in differences between 
x ALO values and their estimates of up to .71. 

However, it has to be stated that the class of 
SSC's having sizes of less than ten individuals each repre- 
sents only 67 out of the 768 officers who graduated in 1972. 
Up to the eighth year after graduation, which was the last 
year observed, only one of the 67 officers was lost due to 
other-than-retirement reasons. From the remaining 701 of- 
ficers belonging to SSC's with sizes of ten and more indi- 
viduals, 119 were lost due to the same reasons. 

Except for group xx2x the trends in the SSC groups 
are results of losses occurring outside the class of SSC's 
with less than ten individuals. These group trends cover 


almost completely the fact that there occurred no loss in 


the small-size class of SSC's except the one in group xx2x. 


gl 





Thus, the D ALO values for those small SSC's are more a result 
of the respective SSC-group trends than of the actual losses 
within the SSC's.  Correpondingly, for SSC's with sizes of 

less than ten individuals the actual group losses due to other- 
than-retirement reasons correlate with a coefficient of .9942 
with the estimates b ALO Of the SSC losses whereas the PALO 


values for the actual individual losses correlate only with 


the coefficient of .06 with their estimates Dar, These ex- 


o 
treme results shown above for graduation year 1972 could not 
be found for the rest of the graduation-years. 

Thus, it cannot be assumed that smaller SSC sizes 
tend to have smaller loss rates or that for smaller SSC sizes 
the Bayesian estimator is less valid. Rather, it has to be 
assumed that the extreme low losses in small-size SSC for 
graduation year 1972 were a result of chance influences and 
that the Bayesian estimator achieved what it was supposed to 
achieve, namely to cope with non-system-inherent chance in- 


fluences mainly on small-sized groups by adjusting the ob- 


served values in the direction of predominant trends. 
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VI. SUMMARY OF CONCLUSIONS AND RECOMMENDATIONS 


A. CONCLUSIONS 

The distinction between retirement losses and losses 
for other-than-retirement reasons that formed the basis for 
the construction of the estimation model was most helpful in 
analyzing underlying trends of the observable losses with re- 
spect to the graduation-year group an officer belonged to and 
with respect to the years after graduation. It led to the 
observation that the estimation and prediction effort can be 
restricted to a relatively short-time period of approximately 
ten years after graduation. The data showed that with the 
tenth year after graduation the relative share of observable 
retirement losses with respect to total losses has already 
reached 81%, with a strongly increasing trend. The data indi- 
cated also that losses due to other-than-retirement reasons 
do not vary linearly with subsequent years after graduation. 
They increase rapidly to a peak level between year five and 
year seven after graduation. Then they decrease steadily. 

In addition it was found that relative to the year of 
graduation accumulated total losses, accumulated retirement 
losses, and accumulated losses due to other-than-retirement 
reasons varied with an increasing trend between graduation 
years 1970 and 1974 and--with the exception of the retirement 


losses--decreased again. 
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The ten SSC groups observed were found to differ signifi- 
cantly with respect to their losses due to other-than- 
retirement reasons. The significance of differences among 
the SSC's within their respective SSC groups was not testable 
because of limitations imposed by the available test 
procedures. 

The extreme variations in the sample sizes among the 41 
SSC's as well as for the single SSC's over time--ranging from 
zero to over 100 individuals--did not affect the applicability 
of the Bayesian estimation technique. The estimates showed 
the expected smoothing effect of the technique, which resulted 
from the fact that the value of the estimate is a compromise 
between the information gained from the behavior of the total 
SSC group and the special behavior of officers in the dif- 
ferent SSC's within the groups. Thus the spoiling effect of 
chance influences especially on small-sized groups could be 
successfully limited. 

Correlating the accumulated total loss rates with their 
estimates resulted in coefficients between .76 for the gradua- 
tion year 1974 and .95 for graduation year 1971. As long as 
only SSC's with sizes bigger than ten individuals each were 
considered for calculating the coefficients, they ranged from 
.94 to .99. The magnitude of the correlation coefficient does 
not only indicate how close the estimates follow their respec- 
tive rates. It was also found to be a useful indicator for 


the differences in the retention behavior of officers belonging 
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to different SSC's within the various SSC groups. A coef- 
ficient of 1.0 would be found only in cases where either all 
SSC groups consisted only of one SSC each or where the loss 
rates for all SSC's within a SSC group were identical for 

all SSC groups. With regard to this interpretation, the cor- 


relation coefficients were surprisingly high. 


B. RECOMMENDATIONS FOR EXTENSIONS INTO PREDICTION MODELS 
Using the estimates for the loss rates (Barro? instead of 


the actual observed rates (r ) provides a more stable and 


ALO 
reliable basis for carrying out predictions of future losses 
of officers who have already graduated and also of losses for 
future graduation-year groups. 

Prediction could be done by using the binomial distribu- 
tion in a way already proposed by McAfee > however, without 
his stationarity assumption, as already discussed. 


Let 


N. ; be the number of officers belonging to SSC j who 


, 


F 


graduate in year i; 


Y be the number of officers belonging to N. . who 


УК X 

have been lost due to other-than-retirement reasons 
up to and including year k after graduation; and 
let 

we be the probability that an officer belonging to 


А5мсд#ее, p NE, Dp. 12“ 
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№ . belongs also to Y. estimated by 


i7) а) и 
SALO;i,j,k" 
Then 


Y 
ES gk 7 YING = п) “| 


у E п-у 
й EN "c5 c 


Because the stationarity assumption about Р, is no longer 


mr 
in existence, future values of P; j,k have to be predicted by 
,7 ,7 


projecting the corresponding b to the future. This 


ALO;i,j,k 
can be done by exploiting known trends and establishing trend 


lines as proposed at the end of paragraph IV.B.3: For each 
year k after graduation and each SSC j, trends of the loss 


estimates DAL over graduation years i are observable. They 


О 
can be translated into trend lines, for example, by using 


regression models. Thus, for all SSC j and years k after 


graduation of interest, b values for future graduation 


ALO 


years i and future years k after graduation or Baro values 


for past graduation years i but future years k after gradua- 
tion are obtainable. 


Using these b values as entries for the respective 


ALO 


р in above equation (19) yields probability statements 


Lek 
about future losses due to other-than-retirement losses. 
Probability statements about total future losses are ob- 
tainable by using an approach similar to that one proposed 

in Chapter V. As long as only expected values of future 

loss rates are wanted, the approach represented by equation (19) 


15 not needed: The predicted b values can be combined 


ALO;i,j,k 
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with the known future r values as proposed in Chapter 


ALR;i,j,K 
V. Thus, expected values of future loss rates will be 


obtained. 
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APPENDIX A-1 
SUBSPECIALTY CODES 


Subspecialty-code Subspecialty title 


Group xx2x NATIONAL SECURITY AFFAIRS 


хх21 Mideast, Africa, or South Asia 
xx22 Far East, Southeast Asia, or Pacific Ocean 
xx23 Western Hemisphere 
xx24 Europe, USSR 
xx25 International Organizations and Negotiations 
xx26 Strategic Planning 
xx27 Nuclear Planning 
Group xx3x  ADMINISTRATIVE SCIENCE 
хх31 Financial Management 
xx32 Material Management 
20:33 Manpower/Personnel Analysis 
xx34 Logistics Management 
xx38 Human Resource Management 
Group xx4x, APPLIED LOGIC AND OPERATIONS SYSTEMS 
TECHNOLOGY 
xx42 Operations Research/Systems Analysis 
xx44 Anti-Submarine Warfare Systems Technology 
xx48 Meterology 
xx49 Oceanography 
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Subspecialty-code 


хх51 
хх52 
хх54 
хх55 


хх56 


хх61 
хх62 
хх63 


хх67 


хх71 


2367 2 


хх81 


хх82 


хх91 


хх95 


Subspecialty Title 


Group xx5x NAVAL SYSTEMS ENGINEERING 
Naval Construction and Engineering 
Nuclear Engineering 
Naval/Mechanical Engineering 
Engineering Electronics 


Underwater Acoustics 


Group xx6x WEAPON SYSTEMS ENGINEERING 


Weapons Systems Technology 
Chemistry 
Weapons Systems Science (Physics) 


Nuclear Effects (Physics) 


Group Xx7x  AERONAUTICAL ENGINEERING 


Aeronautical Engineering 


Aeronautical Engineering with Avionics 


Group xx8x COMMUNICATIONS 
Communications Engineering 


Telecommunications Systems Management 


Group xx9x COMPUTER TECHNOLOGY 


Computer Science 


Computer Systems Management 
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Subspecialty-code Subspecialty Title 


Group 11хх CIVIL ENGINEERING 


1101 Facilities Engineering 
1102 Petroleum Engineering 
1103 Ocean Engineering 


Group l3xx SUPPLY 


1301 Supply Acquisitions/Distribution Management 
1302 Systems Inventory Management 

1304 Material Movement 

1305 Retailing 

1306 Acquisition Contract Management 

1307 Petroleum Management 

1308 Subsistence Technology 
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APPENDIX A-2 


г----------- 
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APPENDIX B 


SAMPLE SIZES FOR SUBSPECIALTY CODES 


SSC 1970 1971 1972 1973 1974 1975 
xx2l 6 7 3 0 3 0 
xx22 4 8 9 11 10 4 
 XX23 4 1 3 4 3 1 
хх24 7 16 5 11 “ 15 7 
хх25 2 4 6 2 1 0 
хх26 8 2 5 4 7 1 
хх27 2 1 1 2 1 0 
хх31 66 66 62 59 56 72 
хх32 32 217) 34 24 33 25 
хх33 3 6 5 7 2 2 
хх34 3 3 4 6 3 4 
хх38 2 3 2 4 7 11 
хх42 45 69 85 96 54 5 7 
хх44 0 1 0 0 0 20 
хх48 4 18 34 23 25 30 
хх49 4 3 SI 44 36 28 24 
хх51 2 8 11 11 9 12 
х5 2 14 6 19 15 18 17 
хх54 44 50 54 38 28 33 
хх55 27 18 27 26 31 18 
хх56 6 7 6 6 11 7 
xx6l 9 10 18 9 6 17 
хх62 10 11 14 12 12 10 
хх63 17 19 20 19 26 22 
хх67 2 3 1 2 2 0 
хх71 25 41 47 54 44 39 
хх72 4 1 2 3 5 5 
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хх81 6 8 15 6 8 9 
хх82 0 31 48 30 33 25 
хх91 21 31 26 22 12 22 
хх95 72 88 57 56 63 34 
1101 31 42 46 34 52 45 
1102 0 1 1 1 0 2 
1103 1 0 0 1 5 4 
1301 14 23 23 13 13 13 
1302 0 4 3 2 4 2 
1304 5 2 6 3 6 5 
1305 3 3 2 3 3 T 
1307 5 4 3 3 0 3 
1308 1 1 0 3 1 1 
1306 8 10 17 8 9 14 
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АРРЕМОЈХ С 
Alternative Derivation of Equation (14) of Paragraph V.A 


The following derivation omits any subscripts. The events 
and probabilities refer to one SSC j of one graduation-year 
and are derived for one year k after graduation. The results 
apply to any i, j, and k observable as stated in paragraph 
У.А. 

Let P(NLO) be the probability that an officer still serves 
in year k after graduation. Let P(R) be the probability that 
an officer reaches his retirement age between graduation and 
year k and actually retires for that reason. 

Let 


P(ALO) - 1 - P(NLO). 


Then the total probability 


| 
| 


P(R) = P(R|NLO)P(NLO) + P(R|ALO)P(ALO) 


However P(R|ALO) = 0 because an officer who left the forces 
due to other-than-retirement reasons prior to reaching his 
retirement age can obviously not retire. Thus 

P(R) » P(RÍNLO)P (NLO) 


NOW 
P (RANLO) 
P (NLO) 


P(R|NLO) = 
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and thus 


|... P (RANLO) 
P(R) - -p (NLO) P (NLO) 


From the data observed 


ALRO 
N 

М - ALO 
М 


P (Ra NLO) and 





P (NLO) 


Thus 


P(R) = я (1 - P(ALO)) 


In order to obtain the probability that an officer will be 
lost between his graduation year and the year k after gradua- 


tion, denoted by P(AL) only P(ALO) has to be added, that is 
P(AL) = P(ALO) + P(R) 


This statement corresponds with equation (8) in paragraph V.A. 


Now 
P(ALO) = =2 
and thus 
ALO ALRo ALO 
= === J 
Bl N-* MW - ADO) | N 


In terms of loss rates this equation is equivalent to 


equation (14) of paragraph V.A. 
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APPENDIX D 
TABLES OF LOSS RATES AND THEIR ESTIMATES 


Appendix D shows in six sections (D-1 to D-6)--one section for 
each graduation year--loss rates and the estimates of the rates 
conditioned on the graduation year and conditioned on the Sub- 
specialty code an officer has obtained. 
- Section D-1: Graduation year 1970 and k = 1,2, ..., 10; 
(Tables 1 to 3) 
- Section D-2: Graduation year 1971 and k = 1,2, ..., 9; 
(Tables 1 to 3) | 
- Section D-3: Graduation year 1972 and k = 1, 2, ... 8; 
(Tables 1 to 3) 


- Section D-4: Graduation year 1973 and k = 1, 2, ... 7 


чө 


(Tables 1 to 3) 


- Section D-5: Graduation year 1974 and k = 1, 2, ... 6 


чө 


(Tables 1 to 3) 


- Section D-6: Graduation year 1975 and k = 1, 2, ... 5 


че 


(Tables 1 to 3) 
The content of the tables was explained in chapter V.C.1 and 
is explained in the respective headings of the tables within 
the six sections. An entry of 99,0 within the tables indicates 
that a rate could not be calculated because nobody having the 
SSC under consideration graduated in the respective graduation 


year. 
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